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A COMPARISON OF SEGMENT FEATURES IN THE SPEECH CHAIN OF 
THREE DEAF-BORN BOYS WITH THOSE OF THREE NORMAL-HEARING BOYS 
REVEALS THAT THE DEAF-BORN HAVE SPEECH PROBLEMS ASSOCIATED 
WITH A LACK OF SYNCHRONY BETWEEN ARTICULATION AND PHONATION. 

IN ORDER TO DETERMINE THE DIFFERENCES BETWEEN THE TWO GROUPS 
(BOTH REPEATING THE SAME SWEDISH SENTENCES), A SPECTROGRAM 
SEGMENTATION METHOD WAS USED, ANALYZING THE MANNER OF 
PRODUCTION AND CORRESPONDING ACOUSTIC CORRELATES OF THE 
SOURCE FEATURES AND RESONATOR FEATURES. SPECTROGRAMS REVEALED 
THAT THE DEAF BOYS' SPEECH DEVIATED FROM NORMAL FATTERNS IN 
VARIOUS WAYS, PARTICULARLY IN AN ERRATIC TRANSITION IN SOME 
PARTS OF THE VOWEL. IN ADDITION, THE ARTICULATION WAS NOT 
ALWAYS UNDER CONTROL, AND THE DEAF BOYS HAD DIFFICULTY WITH 
FRICATIVE ASPIRATION. THE SECOND PART OF THIS TWO-PART STUDY 
DESCRIBES A SPECTROGRAM SEGMENTATION TECHNIQUE IN WHICH 
SEGMENT BOUNDARIES COINCIDE WITH A CHANGE IN THE FEATURE 
COMPOSITION. AN EARLIER MODEL WAS LIMITED BY THE FACT THAT 
SLIGHT SHIFTS IN THE TIMING OF FEATURES CAUSED NEW SEGMENTS 
TO ARISE. ALSO, TIME DURATION OF SEGMENTS WAS NOT INDICATED. 
THE REPRESENTATION OF FEATURES AS A FUNCTION OF TIME WAS 
CONSIDERED MORE ADVANTAGEOUS, AND THEREFORE, A COMPARISON OF 
THE DURATION OF PHONEMES BETWEEN NORMAL HEARING AND DEAF 
SUBJECTS WAS CARRIED OUT. THE RESULTS SHOW A MUCH LOWER RATE 
OF SPEAKING FOR DEAF SUBJECTS. THIS DOCUMENT WAS PUBLISHED IN 
QUARTERLY PROGRESS AND STATUS REPORTS, OCTOBER 1965 AND 
JANUARY 1966, BY THE SPEECH TRANSMISSION LABORATORY , ROYAL 
INSTITUTE OF TECHNOLOGY, STOCKHOLM. <FB) 
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C. STUDIES ON THE SPEECH OP THE DEAF ' 



J. Martony 



.introduction 



The speech of deaf -horn people differs in man/ ways 
from the speech of normal-hearing subjects. The following study 
is an attempt to specify this deviation on an objective level. 
For the description of the speech material a spectrogram seg- 
mentation method has been used 3 and the segment features in the 
utterance of deaf and hearing subjects have been compared. The 
study is of introductory nature only. 



The acoustic chain of speech contains successive min- 
imal speech units (segments) with different characteristics 
(features). By definition the segment boundaries coincide with 
a change in the feature composition. The features describe the 
relevant qualities of the acoustic signal which can be corre- 
lated with the speech production as well as with the speech 



perception. This method of segmentation has been worked out by 

0 ) 



Pant and Lindblom 



There are two typos of features used for description 



of the segments 



1 . 



Segment type features which describe segments by 
their manner of product ion , respectively the 
c or responding acoustic correlates. 



2 . 



Segment pattern features related to the place of 
art iculat ion j and specified by their acoustic 
correlates. 



This study is concerned with .the first category only, 
i.e. segment type features. The description of the segments in 
a speech chain in to mo of those features contains no iniorroation 
about the prosodic features, such as stress, intonation, and 
rhythm. 



The segment typo features are the following: 



Source features: 

U.S. DEPARTMENT OF HEALTH, EDUCATION & WELFARE 
OFFICE OF EDUCATION 



1 , voice 

2. noise 
transient 



HIS DOCUMENT HAS BEEN REPRODUCED EXACTLY AS RECEIVED FROM THE 
ERSOH OR ORGANIZATION ORIGINATING IT. POINTS OF VIEW OR OPINIONS 
TATED DO NOT NECESSARILY REPRESENT OFFICIAL OFFICE OF EDUCATION 
POSITION OR POLICY. ££ 
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Resonator features: 



4. occlusive 

5. fricative 

6. lateral 

7. nasal 

8. vowel-like 

9. transitional 



The material used in this study is the second sentence 
of the text: "Bet ar vackert vader idag. Solen skiner, men dot ar 

kallt". 



This text has been recorded, spoken by three boys with 
normal hearing (HI, H2, H3) and by three deaf boys (hi , D2, B3), 
all in the ages hot ween 13 and 15 years and after their period of 
voice breaking (audiograms of the doaf boys, see Pig. I-C-1 ) . 

The sentence used in this analysis can be transcribed 
in broad transcription ass /suslsn Jisner men deikalt/* 



Pig. I-C--2 shows sonagrarns with segmentation of this 
sentence spoken by the three normal-hearing boys (HI, H2, H3). 

In these sonagrarns one can see that the five words are spoken 
continuously without pause, except for H3? whore there is a pause 
between “skiner" and "men". "Bet ar" is spoken in a colloquial 
manner as J de 253/ or only /do:/. Speaker H2 has a rather reduced 
articulation, he speaks a Stockholm dialect used by teen-agers. 

II3 speaks very well 3 well articulated and clear, but in a col- 
loquial style, A segmentation of the utterances of these normal 
subjects is carried out in Pig. I--C-3. In this symbolic repre- 
sentation the time lengths of the segments are not shown. A mean 
pattern for those throe subjects here referred to as a normal 
pattern has been constructed .and is shown in Pig. I— C— 4» A dis- 
tinction is made between segments and features of primary impor- 
tance and those of secondary importance. The individual pattern 
of speaker H3 comes closest to tho normal pattern. Pig. I~C— 4 
shows the segment type feature pattern for the normal version. 



Bo script ion of g!:ho segments o f the normal p attern 

Segme nt 1 pertains to /s/. Its source feature is noise and tho 



resonator feo/bure is fricative. 
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I-C-3. Segment feature pattern of the test sentence for the 
three normal hearing subjects HI, H2, and H3.- 
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I-C-4. Normalized segment feature pattern of the test sentence. 
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Segment 2 pertains mainly to /s/ "but it is influenced by the 
fol" ' ng /u:/. Its sourcG feature is noise and the resonator 
features are vowel-like and frictivo. The vowel-like feature 
is common at the boundaries between fricatives and closed vowels 
and is realized by the appearance of F2. The friction is reduced 
and at the last 10-1 5 msec it totally disappears. 

Segment 3 pertains mainly to /us/. It has the features voice, 
vowel-like, and transitional. The transitions at the beginning 
of the /us/ are influenced by the /s/ and at the end by the fol- 
lowing /l/. 

Segm ent 4 pertains to N and has the features voice and lateral. 

Segments 3 and 6 pertain mainly to /e /. They are voiced and vowel- 
like. Segment 5 is transitional and 6 is both transitional and 
nasal* One might prefer to include a stationary part in the 
middle of tho vowel, but this did not soem motivated here* The 
nasalization can start earlier. In that case segment 5 falls 
away (see H2). 



Seg ment 7 pertains to /n/. It has the features voice, occlusive, 
and nasal. This segment is not important for the perception of 
/n/ . A strong nasalization of the preceding vowel is a sufficient 
cue. This segment is missing with H3 and is very short for HI 
and H2. 



Se gments G and 9 pertain to / J /. Tho jjf ^ / starts directly with 
a segment (8) with the features noise, fricative, and finishes 
with a segment ( 9 ) with the features noise, vowel-like and frictivo. 
In case tho aliophono [ § ] is used as with subject 112 the feature 
vowel— like coexists in both segments and at the end there enters 
the additional feature transitional. For speakers III and H3 
there is an interval without friction before the vowel of about 
20 msec length. Usually there exists such a segment in the 
boundary botwoon / f f and /i:/but much shorter and of no irnpor- 



t ance . 



S Ugm ou t s 1 0 an d 1 1 por t ain to / i : /, 



The features are voice and 



vowel-like . 



As segment 10 is influenced oven by the preceding 



there is the important additional feature 
Segment 11 is influenced by tho following /n/ 
the additional features nasal and transitional 




transitional • 

■and has therefore 
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S egment 1 2 pertains to /n/ and has the features voice, occlusive, 
and nasal. 

Se rpents 1 3 and 14 pertain to /e/ in "skiner". The first segment 
( 13 ) has the features voice . vowel-like, nasal, and transitional 
because of the preceding /n/ • Segment 14 is not nasalized "but it 
is transitional. For speakers HI and H3 the phoneme /r/ in 
/fi:nzr/ is highly reduced. It is indicated mainly as a special 
formant transition in the preceding vowel. In case segment 
15 </r/) and segment 16 (pause) are missing, in accordance with 
their secondary importance , the nasalization goes through the 
whole of the vowel /e / which is so reduced to one segment, see 
speaker K; (Fig. I-C-3). Therefore segment 14 of the normal 
pattern is of secondary importance only. 

Segment , 13 pertains to /r/ which in this combination is a voiced 
fricative variant. It has the features voice, noise, fricative, 
and vowel-like. This segment is not of primary importance. 

Segment 16 with the only feature occlusive stays for pauses. 

It is not an important segment. 

Segment 17 pertains to /m/ in ’'men" and has the features voice, 
occlusive, and nasal. For speaker H3 this segment is of the 
order of 10 msec length. This is unnaturally short and only by 
the strong nasalization can a normal perceptual effect be achieved. 

Segment 18 pertains to /e /. It has the features voice, vowel— 
like, nasal, and transitional. In the second part of the segment 
the formant transitions are quite slow. The segment is nearly 
stationary and it could perhaps be subdivided into two parts, 
the second one lacking the transitional feature. 

Segment JJ) pertains to /n/. It has the features voice, occlusive, 
and nasal. 

Segm ents 20 and 2 1 pertain to /d/. Segment 20 is the occlusive 
part with the segment features voice and occlusive. This segment 
is related to the interval of velar closure' before the opening 
of the oral passage. In spito of its short length this segment 
is important for a correct /d / , since it allows for tho over— 
pressure preceding tho explosion of the stop sound. However, 
it oan be difficult to identify and is attributed a secondary 
importance here. Segment 20 w»*s found with the speakers HI and 
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H3 but not with H2. In case of H2 oven the following segment , 
i.e. the explosion is missing. Segment 21 is 1 he explosion of 
the stop sound with the features voice and transient. This 
segment is quite weak or missing, if the occlusive part (seg- 
ment 20 ) is too short or missing, as was the case with H2. 

Segment 22 pertains to /o$33 / or /os/ depending on the verifi- 
cation of ’’dot ar" . The segment has the features voice, vowel- 
like, and transitional. The transition at the beginning of the 
segment depends on the preceding /d/ and on the end of the 
following /k/ . 

i 

Segments 23, 24, and 23 pertain to /k/. Segment 23 with only one 
feature (occlusive) is the occlusive part. Segment 24 is the 
explosion with the feature transient. Segment 25 is the aspirative 
part with the segment features noise, fricative, vowel-like, and 
transitional. The /k/ is hero in word initial although phonet- 
ically intervocalic position* Intervocalic, voiceless explosives 
have usually a short aspirative (vowel-like, n^ise) part lacking 
the features friotivo and transitional. The /k/ is in the present 
co,se in word initial position and the aspirative segment is longer. 
The features frictivo and transitional exist but appear to be of 
secondary importance • 



S egme nt 26 pertains to /a/ and has the features voice, vowel— like, 
and transitional. In the middle part of the segment the formant 
pattern is nearly stationary. 



Segment 27 pertains to /l/ and has the features voice and lateral. 

Segmen ts 2 8, 29? and 30 pertain to /t/. Segment 28 is the occlu- 
sive part with the feature occlusive. Segment 29 is the explosion 
with the feature transient. Segment 30 is the aspirative segment 
with the features noise, fricative, and vowel-like. These are 
the common segment features in a postvocalic, final /t/ . Because 
the /t/ here follows a lateral tho aspirative segment has a very 



low intensity and is barely visible. It has therefore been con- 
sidered as of secondary importance. 



Comparisons 



of tho deaf subject,! 



5 spec ch with t he normal p att o rn 



Sonograms with segmentation of the sentence spoken 
by the throe deaf subjects (D1 , 1)2 , D3) are shown in Fig. I-G-5* 
Fig. I-C-6 shows the segment typo features of each segment. 
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“C<-5. Sonag ram of the test sentence spoken by 
the three deaf subjects Dl, D2, and D3. 
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Fig. I-C-6. Segment feature pattern of the test sentence 
° for the three deaf subjects D 1, D 2, and D3. 
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Speaker D1 

Fig. I-C-7 contains Lue sonagram and diagram of 
evaluated segment type features of subject D1 . The correct 
features present are’ marked with x. Features in the normal 
pattern denoted as primary and of secondary importance are 
included as correct. The present but not necessary features are 
marked with fx) • The present but erroneous features are marked 
with v& . Missing features of secondary importance are marked 
with o. Missing features of primary importance are marked with 
0 • 

Segment 4 of 1)1 pertaining to [us] departs from the 
normal pattern by being stationary and nasalized. The misplaced 
nasalization extends throughout segments 3-7 and the major part 
of the sentence. The nasalization is a real problem for this 
speaker. The junction of [n] and [/] (s egments 1 0 and 1 1 ) shows 
irregularities. Segment 10 is a misplaced interval of dovoicing 
due to abnormal rhythm but is not a serious error. [/] starts 
with a transient segment which is erroneous. The voice onset in 
[i:] is delayed, resulting in an additional segment ( 14 ) with the 
features, noise, vowel-like, transitional, but also fricative. 
Without friction this segment could be the starting transitional 
part of the corresponding segment (11) in the normal pattern. 
However, because of the friction, it is related to the [/]. In 
segment 15 the transitional feature, which is considered necessary, 
is missing. The junction [n]-[e] in "skiner" is erroneous too. 
There is an occlusive segment (18) and an explosive ( 19 )* The 
control of the vocal cords and of the velum is not correct here. 
This results in some kind of [d] between [n] and [e]. In segments 
22, 31 ? and 32 there is an erroneous nasalization. Segment 21 is 
an unimportant stationary vowol segment. The /d/ in segments 
29-30 is voiceless and [l] in "kallt" has both voice and noise 
as source features. The aspirativc part of [ t] is missing but 
this failure is not of main importance. 

There is no missing segment feature transitional 
(except in segment 15 ) > but the transitional segments are quite 
short compared with the stationary vowol segments. So, for 
example, in segment 36 we have the feature transitional, but the 
transitions in some parts of the vowel are quite erratic and 
show that the articulation is not really under control. 
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The nasalization is, as mentioned above, a problem 
for the speaker. Voice source quality and pitch range are quite 
good. 



Speaker 1)2 

Fig. I-C-8 shows the sonagram and the diagram of 
evaluated segment features. The initial fricative is of infe- 
rior quality. It is aspirated the whole time and not only at 
the end. (The fricative spectrum is not correct either.) In 
[1] the vocal cord vibration stops. There is a silent segment 
(4) which is followed by a segment with noise as source feature. 
Both the segments (4 and 5) are incorrect. In the following 
vowel [e] in segment 6 the important transitional feature is 
missing. The whole vowel is nasalized. According to the normal 
pattern it should not be so, but this is of secondary importance. 

A lack of transition can be observed in segment 10, i.e. in [i:] 
too. The junction [n”]-[£"] causes some difficulties even for this 
speaker as is the case with speaker D1 . There can be 1 :en a 
voiceless occlusive segment related to the velum closing and the 
vocal cords sot to rest before the oral cavity opens. The release 
is a kind of explosion with a following aspiration. A [ t 1 can be 
heard because of these irregularities. In the [e] in "skiner" 
the features transitional and nasal are missing which both are 
of main importance. The transitional feature in the [e] in "men 1 * 
is an important, missing feature. The /d/ in "de" (segments '22, 
23j24) is voiceless, not only the explosion is voiceless but 
there is also a short aspirativo segment. The result is that 
/d / sounds like a [t]. In [o’] and [al of "de" and "kallt" there 
are stationary segments of no importance. 

The main difficulty for subject D2 is the improper 
control of the vocal cord functions (see segments 4-5> 12 - 13 - 14 ? 
22-23-24) • The vocal cord vibration seems to be too weak. This 
is the reason for the numerous fall out. A second difficulty 
exists in the failing transitional features. The speaker has 
a nearly normal speech tempo and rhythm, but the right speed does 
not always result in a correct transition from one phoneme to 
another. 
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Speaker D3 

Pig. I-C-9 shows the sonagram and the diagram of 
evaluated segment features. The diagram shows that this speaker 
has the greatest number of errors* The voicing after a very 
weak [s] starts only slowly. Consequently there are both voice 
and noise as source features at the beginning of [uj in segment 
3. The noise feature is inconect. The other segments of [us] 
are transitional and stationary alternatively with erroneous 
transitions. The nasalization starts too early already in the 
middle of C wi s 3 in segment 5« Probably the [l3 (segment 7) is 
nasalized too. 



The nasalization continues in the following vowel 
[e] which is not incorrect. The important transitional fea- 
ture is missing there. D3 has difficulties with the correct 
timing of the onset of the vocal cord vibration at the junction 
between [_/* 3 and [is 3 as well as at the junction between Cs3 
and [us 3 (segment 3) and accordingly segment 12 appears as a 
voiced fricative. The whole segment is incorrect. In [i:j 
there are some minor errors owing to missing or too short tran- 
sitions 9 Trie formant transitions are in the following vowels 
missing in the two segments 17 and 22 0 



The ours t segment of /cl/ of "det" is a short voice- 
less fricative instead of a voice explosive. D3 is the only 
speaker in both the hearing control group as well as in the deaf 
group who says "ar" /.or / instead, of the normal reduced form [ej 



or [e3 • There is a nasalization in the segments 28 to 33. The 
[r] ts rolled with very fast occlusions ( maybe uvulas). After 
M fcnere follows four unwanted segments. The whole utterance 
"det ar" is realized as r dears no 3 > spoken very fast at the end. 
/^-/ contains a back fricative [xj and the explosion is missing. 
In segment 38, i.e. [11, the source is incorrect, there are both 
voice and noise as source features. 



The pitch of speaker D3 is very high and he has 
difficulties in joining voiced with voiceless sounds. The ar- 
ticulation is often incorrect too. There are long stationary 
vowel segments with only quite short transitional segments. 

All the stops of D3 are incorrect. " i 
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Summary and discussion 

The comparison mado “between the speech of deaf and 
normal-hearing children reveals fche main difficulty in phonation 
and specially the lack of synchrony "between articulation and 
phonation, c.g. at the junction "between a fricative or a nasal 
consonant and a following vowel. Prominent errors in velar 
functions have "been observed in the form of abnormal and mis- 
placed nasalisation of vowels but also a too early denasalizat ion 
of nasal consonants, 4 

A third characteristic apparent from the study is the 
superst at ionary form of vowels. Transitions are often missing 
or if present they are too short indicating too abrupt articulatory 
movements. Errors in speech rhythm wore not evaluated in this 
study since additional measures would be needed. 

A critical evaluation of the segmentation techniques 
employed in the present work rovoals certain ambiguities in the 
labeling of segments and the determination of their boundaries. 
However, variations in the detailed segment at ional transcription 
of the material would not have effected the conclusions of the 
study. 

A further development of the techniques for articu- 
latory interpretation of spectrograms and perceptual evaluation 
of pattern abnormal it ios by means of synthesis experiments is 
planned. A study of feature distribution in non-normal ized 
time is planned for a coming report . 

R eference s 

(l) Pant, G. and Lindblorn, B.s "Studies of minimal speech 

sound units", STL-QPSR 2/I96I, pp. 1-11. 
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B. STUDIES ON THE SPEECH OP THE DEAF. II 

J • Martony 

• . . * » 

In the first part of this study (published in STL-QPSR 
3/1965) a spectrogram segmentation technique has been described , On 

i* 

the basis of the segment feature pattern we have an objective tool 

for the description of aji utterance and of its possible abnormities* 

tf 

Anyhow, the method has some lacks. By definition the 
segment boundaries coincide with a change in the feature composition* 
An exact determination of segment boundaries is very difficult in 
some instances and by slight shifts of the timing of features new 
segments can arise which are of short duration and usually unimpor- 
tant. The other disadvantage of our earlier approach was that the 
time duration of the segments was not indicated. 

A representation of features as a function of time is 
perhaps more advantageous . In Pigs. III-B-1 to III-B-4 such feature 
patterns are shown. The utterance and the speakers are the same as 
in the first part of the study. 

Pig. III-B-1 shows sonagram and feature pattern of the 
test sentence spoken by the hearing subject H3* Test utterances can 
almost be considered as a normalized feature pattern except for the 
pause between the two parts of the test sentence. Pigs. III-B-2 to 
III-B-4 show sonagrams and feature patterns of the test sentence 
spoken by the deaf subjects D1 , D2, and D3* These sentences were 
discussed in the previous part. 



A comparison of the length of the segments or the features 
for the different speakers is not easy because of deviations in the 
number of segments and features. An alternative method is to study 
phoneme durations as shown in Pig. III-B-5* Of course a determina- 
tion of phoneme boundaries is not unambiguous and to avoid large er- 
rors in some instances adjacent phonemes have been taken together 
in groups. Generally as in Pig. III-B-5 it is apparent how much 
lower the rate of speaking of the deaf subjects is compared with 

1 

that of the hearing subjects. 



A L 

o 



Ooo 077 






e n J i: n e r # msnde 



03 

js: 



D 

in 






i.. ».*. 

* £. 

( 

5 . 

i 

t 

t 

i 



n ' ' * r * 



*jrr vy.-r - •; .i 
* ' ' ’ 



r - 



•* 



J 9 V(.toKMil 






■HU 



.£5:: 

^ r..- 






!':MM 



f 

i. 






i«8y 

-trssr 



*• ; 

■ % * 

i 

m 

\ * »-*“• • .:; 

r~v 

? 



<■ 

V 

i 

\ 

r 

j 

p 

***** . ,***, v»yf > , 

M » I 

O N <0 



.fe . §: . 



■ 3 :- 

.J&L 



Jig 



- -£?)*-> 

it * : '£- 



•# 

? * 



r *L 

'.*-:b 
v» •*. r x^__ 






1 I » 

in 



MM 

•sj co 



I 1 

CM 



I 1 I 

r- O 



ro 



CM 

ro 



ro 



o 

ro 



LO 

CM 



CM 



<J> 



CO 



6 

c 

in 

4-* 

c 

01 

e 

o> 

01 

10 



o 

Q) 

in 



CM 

_o 

CM 

“2 



-52 



-AO 



_(T> 



-2 



_Q 



■cn 



~oo 



•o 



—cn 



-in 



—4" 



—00 



-CN 



c 

0) 



01 „ 

? >., 



Ql 0) 

o o> 

o o 






in 

c 

o 



o 



j-j o l - 

o.22 

O U i 



o 

CD C 
J£ O 



o o> 0} 
in £ £ 
o o P 



l 



\ 







Fig. III-B-1. Sonagram and feature pattern of the test sentence "solen 
skiner men det Sr kallt" spoken by the hearing subject H3. 
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Fig. III-B-5. Phoneme durations in the test sentence "solen shiner men 

det Sr kallt" measured at the three hearing subjects HI, H2, 
H3, and at the three deaf subjects Dl, D2, and D3. 



